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1. Introduction 



The aim of this paper is to study certain strong laws of large numbers for random fields 
in the sense that we shall discuss the (possible) equivalence of certain limit relations for 
sums over random fields of i.i.d. random variables with suitable moment conditions. 

More precisely, let {Ak,kG Z+} be i.i.d. random variables with partial sums S n = 
^ k<n At, n <E Z^_, where the random field or index set Z^, d > 2, is the positive integer 
(i-dimensional lattice with coordinatewise partial ordering <. 

There exist various results on strong laws for random fields in the literature. We now 
very briefly describe some of them. 

For random fields with i.i.d. random variables {Ak,k £ Z+}, the analog of Kol- 
mogorov's strong law (see [17]) reads as follows: 



Sn 

Inl 



-l^X k a -40 E(|A|(log+|A|) rf - 1 )<oo, EA = 0. 

' ' k<n 

Here and throughout, log + x = maxjloga;, 1}. 
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In [7], the first author has considered Marcinkiewicz laws for i.i.d. random fields. To 
be more precise he proved that, for < r < 2, 

S a ™'0 E(\X\ r (log + \X\) d - 1 ) <oo (and EA = when r> 1). 



|n|Vr 



Under somewhat stronger moment conditions, strong laws can be proven under relaxed 
conditions on the distribution and the dependence structure. It has, for example, been 
shown that for d-dimcnsional martingales* (sec, e.g., [14, 19] for a definition), 

S n a.s. _ .„ \ -* ElS'nl 2 ' 3 

-. — r — > it > -; — i < oo for some q > 1. 
|n| |n|9+i 

For a proof, see [14], where orthogonal random fields were also discussed. 

As for the rate of convergence in the strong law for random fields for i.i.d. random 
variables, there exists, as in the one-dimensional case, a law of the iterated logarithm 
(LIL), which reads as follows in the case d > 1 (see [22]): 

limsup ( liminf ) — " = rr\fii(— gy/d) a.s. ^=^> 

iwoo V n ^°° / V 2 l n l lo g lo gl n l 

E / x2 (lQg + |X|) d - 1 \ <oq EX 2 =(J 2 

\ log + log + |Z|7 

In particular, the moment condition and the limit depend on the dimension d. If one 
restricts the limsup to a sector avoiding the boundaries of Z+, the first author has 
proven [9] that the law of the iterated logarithm then holds under the same moment 
condition as in the case d = 1 and has limit points ic. 

A different question concerns the limit behaviour for delayed sums, sometimes called 
lag sums. Let us start with ordinary random variables {X k ,k > 1} and let 
S n+n c — S n = J2k=n+i^k, where < a < 1 and, to be precise, n a := [n a \. For i.i.d. 
summands {Xk,k> 1}, we then have (sec [5, 15]) 

lim n '" + "° = a.s. E|A| 1/a <oo, EX = and 

n — >oo n a 

limsup ^+"°- = 7l-^ a.s. <=>► E(|A| 2 /"(log + |X|)- 1 /«)<oo, 
n^oo \l 2.n "logn 

EA 2 = 1, EA = 0. 

We call the latter result a law of the single logarithm (LSL). Such results are of particular 
interest since they help to evaluate weighted sums of i.i.d. random variables for certain 
classes of weights. Especially in the case a = 1/2, it has been shown (see, e.g., [1, 5]) that 
certain summability methods, such as those defined by the delayed sums, Euler, Borel and 
certain Valiron methods, are equivalent for sequences {s n , n > 1} satisfying s„ = o(n 1 / 2 ). 
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The latter remains a.s. true for random variables with the moment condition EX 2 < oo 
since the partial sums then satisfy S n = o a s . (n 1 ^ 2 ) . Other equivalences with limit relations 
for delayed sums were given in [3] . These results allow one to prove a law of large numbers 
and, using a similar idea, an LSL for the associated weighted sums (see, e.g., [4]). Since 
multivariate summability methods have attracted new interest, multiindex versions of 
Chow's and Lai's results are of interest. 

Hence, the aim of the present paper is to investigate the LSL problem for delayed sums 
of random fields with i.i.d. components. The strong law itself was established in [20]. 

The paper is organized as follows. We begin, in Section 2, with definitions and the 
statement of our main result, after which we collect various preliminaries in Section 3 
and the truncation procedure and the Kolmogorov exponential bounds in Section 4. Thus 
prepared, we present the proof of our main result, the LSL for delayed sums. Examining 
the proof, it turns out that one can also prove an LSL for subsequences, the result of 
which is given in Section 6; in particular, this result is also valid for the case d= 1. A 
closing section contains some additional results and remarks. 

2. Setting and main result 

Let Z^, d>2, denote the positive integer d-dimcnsional lattice with coordinatewise par- 
tial ordering <, that is, for m = (mi, m,2, . . . , m^) and n = (m, ri2, • • rid), m < n means 
that ?Tife < nfc for k = 1, 2, . . . , d. Similarly, n Q = (n", i • ■ • i n d)- The " s i ze " °f a point 
equals |n| = n k- Moreover, n — * oo means that — > oo for all k = 1, 2, . . . , d. We 

shall also abuse notation for simplicity and treat the coordinates of n° as integers. Finally, 
C denotes a numerical constant which may change from appearance to appearance. 

Throughout the paper, X and {Xk,ke Z^} are i.i.d. random variables with partial 
sums S n = J2k<n X k, neZj. 

For d= 1, the (forward) delayed sums are T„. n +k = X^= n +i Xj,k > 1, that is, the 
increments from S n to SVi+fc. For d — 2, the analog is the incremental rectangle 

-^rijii+k ^ni+fei ,n2+/c2 ^ni+fei,Tt2 ^ni,n2+/c2 ^ni,ri2 

and for higher dimensions, the analogous d-dimcnsional cube. 

The aim of this paper is to prove a law of the single logarithm for the family of delayed 
increments or windows 

{T n , n+na ,neZ d + }. 
Our main result is the following. 

Theorem 2.1. Suppose that {Xk,ke Z^} are i.i.d. random variables with mean and 
finite variance a 2 , and set S n = X)k<n^k, n £ Zi_. If 



EX 2 / Q (log + |X|) d - 1 - 1 / Q <oo, 



(2.1) 
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where < a < 1, then 

limsupf liminf J — n,n+n _ Jr(T ^/^ _ a ^_ a ^J\ _ a j 
n-»oo \ n ^°° / ^2|n| a log|n| 

Conversely, if 

pAiTr, H ,, r - lZ °- n+n ° l <0Q^ >o, 

V n^oo ^In^loglnl / 
fTien (2.1) ZioZcfe, EX = and (2.2) /io/ds wi/i a 2 = VarX. 



3. Preliminaries 

We first observe that a partial sum S a is a sum of |n| i.i.d. random variables, which 
implies that distributional properties and various inequalities do not depend on the (par- 
tial) order of the index set and thus remain valid "automatically" . However, the Levy 
inequalities, for example, concern the distribution of maxk< n Sk and here the structure 
of the index set enters. 

Lemma 3.1. Suppose that {Xk,kg Z^} are independent random variables with mean 
and partial sums S n = X)k<n^k- 

(a) //, in addition, the summands are symmetric, then 

P (maxS k > xj < 2 d P{S n > x). 

(b) If the variances are finite, then 

pfmax5 k >a;J < 2 d P(S n >x- d^2 Var(S n )). 

The proof is based on induction over the dimensions. For details (in the i.i.d. case), 
see [8], Lemma 2.3. Two-sided versions are immediate. 

We also need relations between tail probabilities and moments analogous to the one- 
dimensional 

oo 

E|X|<oo J2 P (\ X \ >n ) <0 °- 

71=1 

More precisely, we wish to find the necessary moment condition to ensure that 

£j>(|*|>|n|)<oo. (3.1) 

n 
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For this, it turns out that the quantities 

d(j) = Card{k : |k| = j} and M(j) = Card{k : |k| < j} 
and their asymptotics 

M(j) 1 



and 



as j — ► oo (3.2) 



d(j) = o(j s ) for any <5 > as j oo (3.3) 

play a crucial role. We refer [12], Chapter XVIII and [21], relation (12.1.1) (for the 
case d = 2). The quantity d(j) itself has no pleasant asymptotics in the sense that 
liminfj^oo d(j) = d and limsup^^ d(j) = +oo. 

We shall also exploit the fact that all terms in expressions such as the sum in (3.1) 
with equisized indices are equal, which implies that 

oo 

Y,P(\X\ > |n|) = E E d U) P (\ X \ > 3) ( 3 - 4 ) 

n j=l \n\=j 

in that particular case. 

This fact, partial summation and (3.2) yield the first part of the following lemma; see 
also [17]. The second part is a consequence of the fact that the inverse of the function y = 
x a (\ogx) K behaves asymptotically like x — y 1 / Q! (logi/) - ' K / Q ) (except for some constant 
factor(s)). 

Lemma 3.2. Let a > and k€I and suppose that {I k ,ke T\) are i.i.d. random 
variables with mean and partial sums S n = X)k<n^ k - Then 

J2 P (\ X \ > |nr(log|n|) K ) <oo <S=> E|X| 1 / Q (log + |X|) d - 1 - K / Q <oo. 

n 

For purely numerical sequences, we have the following 
Lemma 3.3. Let K > 1, 9>0 and 

y, 1 _^ d(i K (logi) r i) j<°°> when 6 

»=2 {n:|n|=i«(logi)"} «=2 V 6 ' = OO, when < - . 

Proof. Recalling (3.4), the convergence part follows from (3.3) and the divergence part 
from the fact that d(i) > d for all i. □ 
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4. Truncation and exponential bounds 



The typical pattern in proving results of the LIL-type requires two truncations; the first 
to match the Kolmogorov exponential bounds (see, e.g., [11], Section 8.2) and the second 
to match the moment requirements. 
To this end, let S be small, let 



bn = bH = °A^ (4.1) 
e log|n| 



and set 



X' n = X n I{\X n \ < b n }, X£ = X n I{b n <\X n \< ^v^nFlogTR}, 
X™ = X n I{\X n \ > JV|n| tt log|n|}. 

In the following, all objects with primes or multiple primes refer to the respective 
truncated summands. 

Since truncation destroys centering, we obtain, using standard procedures and noting 
that EX = 0, 

mL] = ,-Ewy > < mmXkl > W < g^gW 

so that 

EX 2 (log+|X|)W2 /{ | X |>6 k } 



|Er; n+nQ |< J2 



^(logfek) 1 -"/ 2 

n < k < ii fn' v v ' 

EX 2 (log+|X|)W2 /{ | X | >bn} 
' Mlog& n )i-«/a 



(4.2) 



Moreover, 



so that 



< Cv/|n|«(log|n|)«-EX 2 (log + IXI) 1 -"/ 2 /^! > &„} 
= o(-\/|n| Q log |n|) as moo. 

VarX n < EX 2 < EX 2 = a 2 

Var(T' n „) < |n| V 2 . (4.3) 



An application of the Kolmogorov upper exponential bound (see, e.g., [11], Lemma 8.2.1) 
with x = e(l — <S)-y/21og|n| and c n = 25 /x (note that = o(c n y / Var(T n+n c<)) for n < 
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k < n + n Q ), together with (4.2) and (4.3), now yields 



^(l^, n+n «| W2|n|°log|n|) 

< P(K, n+n « - ET^ a+aa | >e(l- 5)V2|n|«log|n|) 



<^ IT' +„«-ET' a | > ^ V2Var(T' «)log|n| (4.4) 



<exp<j L_J_iog| n |(l-<y) 



In order to apply the lower exponential bound (see, e.g., [11], Lemma 8.2.2) we first need 
a lower bound for the truncated variances: 

VarX; = EX' n 2 - (EX^) 2 = EX 2 - EX 2 I{\X n \ > b n } - (EX' n ) 2 

> a 2 - 1EX 2 I{\X n \ > b n } > cr 2 (l - 5) 

for |n| large, so that 

Var(T^ n+na ) > |n|<V 2 (l - S) for |n| large. (4.5) 
It now follows that for any 7 > 0, 



P(T' +a * > eV2|n|«log|n|) 



> P(TL n+ ^ - ET^ n+n „ > e(l + aV2|n|<Mog|n|) 

> P (TLn+n* - ET; n+na > ^7== yfi Var(T 1 i. n+nQ ) log|n|) (4.6) 



2e 2 (l + S) 2 
2a 2 (l-5) 

( e 2 (l+^(l +7 ))/( CT 2 (l-*)) for | n | laJ . ge 



> ex Pl~ o 2„ L tog|n|(l+ 7 ) 



5. Proof of Theorem 2.1 

We follow the general scheme of [15], although some of the technicalities become more 
complicated due to the more complicated index set. 



5.1. Sufficiency — the upper bound 



We begin by taking care of the double- and triple-primed contributions, after which we 
provide a convergent upper Borel-Cantelli sum for the single-primed contribution over 
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a suitably chosen subset of points in TA. After this, we apply the first Boreh-Cantelli 
lemma to this subset and then "fill the gaps" in order to include arbitrary windows. 

5.1.1. r n n _|_ na 

In this subsection, we establish the fact that 

v |-^n,n+n a I ~ & /r i\ 

hmsup — — < a.s. (5.1) 

n-»oo ^|n| a log|n| I- a 



In order for |Tn' n+n a|, to surpass the level 77^/|n| Q log |n|, it is necessary that at least 
N > rj/5 of the X"'s arc non-zero, which, by stretching the truncation bounds to the 
extremes, implies that 



P(K, n+na | > vVH a \og\n\) < ( ) (P(b n <\X\< M|n| + |nh)log(|n| + |n|«))) 

<\n\ aN (P(\X\>C\n\ a P/log\n\)f 

E\X\ 2 / a (\og + \X\) d - 1 ~ 1 / a 



N 



< C\n\ aN 
= C 



(\n\ a /y log |n|) 2 /«(log | n |)d-i-i/ Q 

(log|n|) JV « 3 / a )+ 1 - <i ) 
|n|JV(i-«) ■ 



Since the sum of the probabilities converges whenever N(l — a) > 1, considering that, in 
addition, N5 > n, we have shown that 

E P d T n, n+n» I > vVW^H) < °° all V > , 

4 — ' 1 — a 

n 

which establishes (5.1) via the first Borcl-Cantclli lemma. 

O. 1.6. -t nn+n c 

Next, we show that 

IT'" I 

Urn n - n+n °' = a.s. (5.2) 
V|n| Q log|n| 



This is easier, since, in order for |T^" n+n o|'s to surpass the level ?7\/|n| a log |n| infinitely 
often, it is necessary that infinitely many of the X""s are non-zero. However, via an 
appeal to the first Borcl Cantclli lemma, the latter event has zero probability since 

n n 

if and only if (2.1) holds; recall Lemma 3.2. 
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5. 1.3. T^ n+na 

As for T' n n+n a, we must resort to subsequences. Set Ai = 1, A2 = 2 and, further, 
/ i \V(i-«) 

\= : , i = 3,4, and A = {Ai,«>l}. 

Our attention here is on the subset of points n = {n\ , 122, ■ ■ ■ , n^) <G such that rife € A, 
that is, rifc = Xi k for all fe = 1, 2, . . . , d, in short n G A. 

Suppose that n G A and set i = IIfc=i This implies, in particular, that ik <i and 
that logifc < logi for all so that 



H=n A 



1 / Utih \ 1/(1 - Q) . iV(i-a) 



fe 



> 



With this and (3.3) in mind, the estimate (4.4) over the subset A now yields 

. 11 -\- n ' v 

I > e-\/2|n| Q log |n|) 

{nGA} 

{neA} 1 1112=1**1=* 

<c+e d( ? ) l -( £2 « i - 5 ) 3 - 25 ))/^ 2 ( i - Q )) < 00 

i>i 



(5.3) 



for e > cry ( 1 _ 1 A -)"„ 2 g (where io was chosen such that (logi)^ 1 ^ < i* 5 and <i(i) < 
5.1.4-. Combining the contributions 

We first note that an application of the first Borcl-Cantclli lemma to (5.3) provides an 
upper bound for limsupT^ n+n » as n— > 00 through the subset A. More precisely, 



l T n,n+n°l / 1 Oi 

hmsup — = < a, / — — — a.s. (5.4) 

n^oo P ^2|n|«log|n| " \j{l~5Y-28 V ' 



{nGA} 

Combining this with (5.1) and (5.2) now yields 



,. |T ni „ + „ Q | / I- a 5 

hmsup — = < cr. / — rr^ — + 

n^oo V 2 |n| Q log|n| " V 0- - d ) 3 - 2(5 1 - 1 

{nSA} 
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which, due to the arbitrary nature of S, tells us that 



limsup — j n,n+n J — < — rv a.s. (5-5) 
n^oo ^2|n| Q log|n| 

{n£A} 

5.1.5. Filling the gaps 

Thus far, we have shown that the limsup for a special subsequence is as desired. We must 
now show that the limsup remains the same for an arbitrary sequence. For the usual LIL, 
this is typically done by studying the gaps between subsequence points with the aid of 
the Levy inequalities. Here, however, we must proceed differently. 

Since the procedure is the same in all dimensions, we restrict ourselves to carrying out 
the details for the case d=2. Since, in the following, we shall use the letters to and n for 
x- and y-coordinates, respectively, we set 

rrij = rij = Xj , j > 1 , 

that is, the points (rrij,nk) for j, k = 1, 2, . . . are the Southwest corners of the windows 
we have considered thus far. 

The first step is to show that the selected windows overlap, that is, that they cover all 
of Z^. For this purpose, it suffices to consider squares. We thus wish to show that 



that is, that 



to; + mf > TOi + i for all i, 



V(l-") / „• \ «/(!"«) / ■ i i \V(l-«) 



> 1 — T- — TT for aU i ^ 3 > ( 5 - 6 ) 



logi/ \\ogi J \log(i + l) 

in other words, that the Northeast end-point of one square overlaps the Southwest end- 
point of the following Northeast-square. This, however, follows from the fact that 

(VQogi)) 1 /' 1 -") + (Vflogz))"^ 1 -") 
((i + l)/(log(i + l)))V(i-«) 

i log(i + 1) \ 1 ^ 1 / log i 



(i + 1) \ogi J \ i 

log(i + l)\ / 1 \ / logz x 



log i ) \ i + 1 

1- 



\ l/(l-a) / -, ■ \ l/(l-a) 
1 \ ! ' I log I N 1 



i+lj V * 

1/ i log? NX 1 /^-") 

> 1 + - logt r-^x- >1 for?>3. 

i V i + 1 i(i + l)JJ 
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m + m a i n + 




















(■HI; Tt) 




(m + m tt ,n) 



Figure 1. A dotted arbitrary window. 



Next, we select an arbitrary window, 



-^((m,n) , (m+m a ,n-{-n a )) • 

Since, trivially, we have + < rik+i + n^ +1 (as well as rrij + m" < mj + i + m" +1 ), 
it follows that an arbitrary window is always contained in the union of (at most) four 
selected windows as depicted in Figure 1. 

The program for this subsubsection is (essentially) to show that the discrepancy be- 
tween an arbitrary window and the original ones is asymptotically negligible. 

From (5.4), we recall that 



,. \ T n,n+n"\ . / 1—Ot 

hmsup — = < a* — -r^ — — a.s. 

n^oo v /2|n|«log|n| " Y (1 - 5) 3 - 2(5 

{n:|n|— Aj} 

We wish to show that the same relation holds for the full subsequence, that is, that 



I r n,n+n°l ^ / 1—Ot 

hmsup — = < a* / — — ■= — — a.s., 

n^oo P v /2|n| a log|n| " y(l-<y) 8 -2i 

which, remembering that we are restricting ourselves to the case d = 2, transforms into 



hmsup - a \n aT3 — ^ a - s - 

i^oo J2m%n%\og(mjnk) V ^ > ~ 
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by showing that 



lim sup max 

j,k-^>oc mj<m<m j+1 
n k <n<nj_(.i 



il=m 2—ii 2 =n iiM L-ii\=mj 2—ii 2 =n 



X L,i2 



^2m a n a \og(mn) ^ 2 mfn% log(mjn fe ) 



= 



a.s. 



However, since n^x/n^ — > 1 as fc — ► oo (and rrij+i/mj — * 1 as j — > oo) it suffices to show, 
say, that 

Em+m° -v-' _ >p m J+ m ? V^"fc+ Il fc V"/ I 

i\=m L-iii=n i\,i 2 Z—ii\=m; L-ii 2 =n k ii,i 2 ' n i r n \ 

limsup max = a.s. (5.7) 

j,fc-oo mj<m< mj+1 A /m>?log(m,n fc ) 

By combining this with our previous results concerning T£ n+n a and T^' a+n a , as in the 
previous subsubsection, we are then in the position to conclude that relation (5.5) holds 
for the full sequence, that is, 

T |-^n,n+n°| , r\ 

limsup — < cry i — a a.s., 

n^oo ^In^loglnl 

as desired (since now d = 2). 

In order to pursue our task, we separate the index set into 3 pieces (since d = 2) 
depending on whether the arbitrary window is located in "the center" or "near" one of 
the coordinate axes (for a similar discussion, cf. [8], Section 4). 
The center; j, k > M , M large 



Proof of 5.7. Let D mtn denote the random variable in the numerator of (5.7), that is, 
set 

m+m" n+n a ■mj+m" n k +n k 

D m ,n= E E X n^2~ E E X *'i-*2 

ii—m-\-l i2—n-\-l i±= mj + 1 22—^^ + 1 

m+m a n+n" m j ~^ 7n j n-\-n a 

E E X U+ E E Km ( 5 - 8 ) 

i-\—m.i-\-m oe -\-l io— n+1 21—771+1 zq— n^+nf + l 

■> 3 K 

ii— m-j+1 22— 7lfc+l ii—rrij-\-li2=n-\-l 

The corresponding random variables are located in the shaded area in Figure 2. 
As for the truncated means and variances, we recall that 



EX^ = o( v / log(|k|)/|k| a ) as k -> oo, and that VarA^ < E(X^) 2 < a 2 
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which, in the present case, means that 
EX' iul2 =o(y / log(TO j n fe )/(m«n«)) asj,fc^oo, and that V&r X' li l2 < a 2 , (5.9) 

uniformly in i\ > nij and 12 > Tifc. 

In order to compute the mean and variance of D m ^ n , we need an estimate of the number 
of summands involved in (5.8). 

As a preliminary, we note that, via the mean value theorem, 



j + l \V(i-«) / j \ V(i-o) 



iog(i + i)y V lo gi 

1 



as j — > 00 , 



7717,1 — m„ 



1 - a (logj')V(i-«) 



,-(2q-1)/(1-q) 



as ^ — > 00 . 



1 - a (logj)"/' 1 -") 
Since 2a — 1 < a, we also note that 

m" +1 — to" = o(rrij+i — rrij) as j — > 00. 

Analogous relations obviously also hold for nfc+i — and n^ +1 — 
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Using all of this, we find that the number of summands in (5.8) equals 

Card(_D m .„) = (m + m a — rrij — m")n a + (rrij + to" — m)(n + n a — n k — n^) 
+ m°(n- n k ) + (to - m,j)(n k + n%—n) 
< K'+i + - rrij - m<*)n k+1 + m°-(n k+1 + n k+1 - n k - n k ) 
+ m"(n k+ i - n k ) + (m j+1 - mj)n% 

ja/(X-a) I \^ a /( 1 ~ a ) jfea(l-a) ( j ^ a /( 1_a ) 



(logi) 1 /^-") Vlogfc J (logfc) 1 /( 1 -") \l0gj 

= Cm >Ki^i7 + i) as ^-°°- 

Combining this with the estimate for the truncated expectations and variances in (5.9), 
we conclude that, for rrij < to < rrij+i, n k <n < n k+ i and j, k — ► oo, 



E(D m , n ) = o^mfni lo g (m,n fe ) (j^y + j^) ) 

and 

Var(An,„) < Cntfng f r^- + r^rV 2 - 

3 Vogj logfcy 

Now, let rj > be arbitrarily small. Using the upper exponential inequalities, wc obtain, 
for j, k large, 

p( ; = >2r? 



^rnf*nl \og(mjn k ) 



'mfn^ \og(mjn k ) 



= P ( |Dm,n - EA n ,„| > W J ^ y/Vm D m , n 



.p/, n logjlogklog(mjn k ) ^ — n \ 

<P[ \D m n - ED m n \ > Cm/ — f ^VarD m „ 

V V logj+logfc v J 

~ P(\D m ,n - EL» mi „| > Crjy/logj log fc^/Var An,™) 
< cxp | - i C?7 2 log j log fc 

independent of (n,m) G [to^ , to j+ i] x [n^, Tifc+i]. Next, let M large be given and let j, k > 
e 2M . Then, 

log j log k > M(\ogj + log k), 
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which implies that 



2 

and, hence, that 



exp{-iCV logjlogfc} < exp{-iCyM(logj + logfc)} = (jk)- c i° M 



\D rnn \ 

max — ■ > 2-q 



m 3 <m<m J + 1 / m « n " l g(m,n fc ) 
n k <n<n k + 1 \ ■> K 

< (fHj + i - mj){n k+1 - n fc ) max P ( ; > 2? ? 



rrij <m<mj+i 
n k <n<nj+i 



•a/(l-a) ua/(l-a) 

~ (logj) 1 /( 1 -«) (logfc) 1 /(i-«) Wj 
<C(ifc)- c " 2M , 

so that, by choosing M sufficiently large that Cr/ 2 M > 1, we may finally conclude that 

P [ max — : m '"^ = > T] J < oo for any ?y > 0, 

7^ V"i<"^»i+i /m«n«log(m^ fc ) / 

which, in turn, verifies (5.7) - for an arbitrary "central" window. □ 
The case k < M , M large 

For the "boundary" cases, we consider a denser subsequence, namely 

Aj.k = Uj, k)eZ 2 + : mj = {^—) , J > 3, and fe = 1,2, . . . ,M 

A consequence of this is that additional windows are involved so that we must first 
convince ourselves that the upper bound of the lim sup of the thus chosen subset remains 
the same. Since, as we have seen, the double- and triple-primed contributions do not 
contribute, it follows that it suffices to investigate r^ n+nQ . In fact, borrowing from 
(4.4), we have, for n= (m,j,k) large, 



P(K, n+n «\ > eV2n«log|n|) < \ n \-^i-sf)/^ = (m^)"^ 1 " 

so that 

E P (l T n,„+„*l W2n Q log|n|) 

{n=(j,fc)(EA i , fc } 
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< 



^E 



3=3 

which is the same as 



logj 



< oo for e > 



'<7 2 (l-q) 



Z^j 1= n,- Z—ii 2 =k »i,ia . / 1 Q' 

limsup , — < <j\ 



j — >°° 

{U,k)£A 3 , k } 



2n"k a \og{n j k) 



{i-sy 



a.s. 



(5.10) 



To complete the proof for this case, it remains to establish the analog of (5.7), that is, 
that 



Y^m" n a log (rrij n) 



lim sup max 

j >cyo rrij <m<77ij-|_i 

n<M 



a.s. (5.11) 



Proof of (5.11). With D m n as the random variable in the numerator of (5.11), we 
have 

a*»= E E *U- E E^*= E E *U+ E E > 

i\ — ra^rXii— n+1 ?i— mj+1 22— n i\—mjii—n-\-\ ii—rnj+m^i^—n+l 

which corresponds to the shaded area in Figure 3. 
Continuing as before, we find that 

Card(D mi „) — (m + m a — rrij — m")n a + (m — m,j)n a 

< (rrij + i + m° +1 — rrij — m")n a + {mj + \ — rrij)n a 
,-«/(!-«) mfn a 



(logi)V(i-«) 



logj 



(m, n + n a ) 



m + m a , n + n a ) 




(m,n) 



(to + ra Q ', n.) 



Figure 3. The shaded difference. 
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Combining this with the estimate for the truncated expectations (which, in this case, 



corresponds to EX; i rl = o(y'log(m : ,n) / 'm^n a )) and variances in (5.9), we conclude that, 
for rrij <m< rrij+i , n < M and j, n — > oo, 



'm"n a log(m J n) ^ i ^ ^ ^m"n° 



E(D m>n ) = o[ \ and Vax(D m , n ) < C-^—o z . 

The exponential inequalities therefore yield 



, == >2r? = P |£> m ,„ -ED m , n | >V\ ^tj — p; V VarI ^ 

Wm^n a log(m.,n) / V V VarI W 



< P(|D m ,„ - ED m ,n| > Cr] J log j\og{mjn) ■ ^Var £> m ,n) 



~ P(|-Dm,™ - EAn,«| > C77 log j 0og ra ^/ Var D m , ~ ) 
< expl -]-Crf [log]) 2 lognl < expl -^C^log j) 2 



so that 



max |A "' Tt| — > 27? 

vmj <m<m J + 1 / m « n olog( m , n ) 
n<M V 5 



< (TOj+i — nij)M max PI — ' > 2r/ 

rrij <m<mj-)-i 
n<M 



. ^Jm^n a log(mjn) 

^ (^ exp r^ (losi) } 



< exp<j -ic77 2 (log j) 2 + — !— log j 
2 1 — a 



-\crf{logjf 



from which we finally conclude that 

P ( max — I > 77 ) < oo for any r) > 0, 

i V l j<m<m j + 1 m " n a\ og ( mn ) 
J n<M V 3 

which, in turn, verifies (5.11). 
ITie case j < M, M large 
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This part clearly follows in the same way as the previous one by interchanging the roles 
of j and k. □ 

This, finally, concludes the proof of the upper bound 

limsup — I I — <gy/l — g a .s. (5-12) 
n^oo ^|n| Q log|n| 

5.2. Sufficiency — the lower bound 

We first derive a divergent Borel-Cantelli sum for the single-primed contributions re- 
stricted to the subsets of windows based on the subsequence Ai = 1, X2 = 2 and 
Aj = i 1 ^ 1 ™"), i > 3. More precisely, in dimension 2, the Southwest coordinates are 
(i 1 /( 1_Q ) 7 k 1 ^ 1 " 01 ^), the horizontal widths arc i Q /( 1-Q! ) and the vertical widths arc 
fe a /( 1_a ) j i,k> 1. (See Figure 4.) In order to apply the second Borel-Cantclli lemma 
to this subset, we then show that this provides an independent subset of windows. Com- 
bining this with (5.1) and (5.2) provides a lower bound for the subset and, further, for 
the whole set. 

5.2.1. T n n+n a 

Let A denote the set of Southwest coordinates involved, that is, set 

a r _ rr2 1. 1/(1— a) .1/(1— ah ■ . x ,1 

A = {neZ+:n=(i 1 /v \i 2 ' K ; )>*i,«2>l}- 



((«+l)l=^,(fc+l)^) 



(i 1_Q , k !- Q ) (t 1 -" -+- i 1 ~ a , k 1_ '> ) 



Figure 4. Independence of windows. 
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E PCC. + n- WM°log|n|)> £ | n |-(^ + *) 2 (i + 7))/(^(i-*)) 

{n£A} {n£A} 



E d( l )z-^( 1 + 5 ) 2 ( 1 +7))/(- 2 (i-«)(i-^)) = oo 



tOI all £ < cry (l+5)2(i +7) - 

5.2.2. Independence 

In order to prove that the selected windows are disjoint, it suffices to check that, through- 
out, each coordinate with index i + 1 is larger than the corresponding coordinate of n+n° 
with index i. This means that we must show that 

•l/(l-a) + .a/(l-a) < ^ +1 )l/(l-a) for a lH. (5.14) 

However, this follows from the fact that 

jV(i-«)+i«/(i-") ( i \V(i-«) f \\ f i ^"/i 1 -") 



5.2.3. Combining the contributions 

We have just shown that the selected subset of windows is disjoint and, hence, that the 
events considered in (5.13) are independent. An application of the second Borel-Cantelli 
lemma therefore tells us that 



^,n + n^ . (l-a)(l-S) 
lim SUp — . = >(Tl — r . 

^|n| Q log|n| - V (1 + <5) 2 (l+ 7 ) 

{n:n£A} 

Combining this with (5.1) and (5.2), it follows that 



T n , n+nn (l-q)(l-J) 5 

hmsup — = > a* -, ttttt r a.s. 

n^oo ^|n|«log|n| " V (l + 5) 2 (l+7) I- a 

{n:nei} 

Therefore, due to the arbitrary nature of 8 and 7, it follows that 



limsup — = = — > ery] — a a.s. (5.15) 
n^oo ^/|n| a log|n| 

{n:n£A} 
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and, since the overall limsup is obviously at least as large as the selected one, that 

limSUp — ">"+" >g\/\—a a.s. (5.16) 

!woo ^/Inl" log |n| 

5.2.4- Final step 

The proof of the sufficiency is completed by combining (5.12) and (5.16). 
5.3. Necessity 

If (2.3) holds, then, by the zero-one law, the probability that the limsup is finite is or 
1. Hence, being positive, it equals 1. Consequently (cf. [15], page 438 or [17, 18]), 

limsup — = < oo a.s., 

rwoo v/|n|«log|n| 

from which it follows, via the second Borel-Cantelli lemma and the i.i.d. assumption, 
that 

^>^P(|X n |> V|n|«log|n|) 

n 

= X>(l*l>V|n|*log|n|). 
n 

This verifies (2.1) in view of Lemma 3.2 (with j3 = 1). 

An application of the sufficiency part finally tells us that (2.2) holds with a 2 = Var A. 

6. An LSL for subsequences 

As we have seen, it follows from (5.1) and (5.2) that the values of the extreme limit 
points are determined by the behaviour of T' n n+nQ . In this section, we shall exploit this 
fact further and prove an LSL for subsequences (paralleling [10], where this was done for 
the classical LIL; cf. also [11], Section 8.5). 

To this end, we replace the set A in the computation of the upper bound by the set 

h* = {\* = \P=iP /{1 - a \i>l} (6.1) 

and, consequently, A by A*. 

Now, if all coordinates of n belong to A* (in short, n <E A*), then so does |n|, that 
is, the "size" of the points in Z+. This means that X){ n eA*} = S{ n -|n|eA*} > ^ na ^ ' 1S ' 
summation runs over a sequence of hyperbolas approaching infinity. 
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With this in mind, an inspection of the computation of the upper bound of T n nH 
)gcther with an application of Lemma 3 
rj = 0, reveals that formula (5.3) becomes 



together with an application of Lemma 3.3 with re = /3/(l — a), 6 = e 2 (l — S) 3 /a 2 and 



E ^(in,„+„=lW|n| a log|n|) 

{n G A*} 

= E E P(K, n+n «l>eVH a logM) 

i {n:|n|=»0Ai-°O} 

<E E | n |-(- 2 Ci-*) 3 )/- 2 <oo (6.2) 

i {n^nl^/C 1 -")} 



for all e > o-J -^^s . Moreover, with i raised to the various powers in the computations 

of the lower bound replaced by i raised to /3 times the same powers and the index set A 
replaced by 

A , = {neZ 2 + :n=(^( 1 - a ),)t W(1 " a) ), * > 1}, (6.3) 
(5.13) transforms into 

E ^U„* W|n|«log|n|)> E |n|-CW-H»)"(i-Hr))/(^(i-0) 

(6.4) 



E^( 



l (e^(l+<5)^(l+ 7 ))/(^(l-a)(l-5)) =( , 



for all p <- rr / (l-a)(l-<5) 

tor all e < cry /3(1+5)a(1+7) • 

By combining these estimates with (5.1) and (5.2) as in the proof of Theorem 2.1, we 
obtain the following LSL for subsequences. 

Theorem 6.1. Suppose that {X^,]s.G Z^} are i.i.d. random variables with mean and 
finite variance a 1 , set S n = X)k<n^ k ' n an d ^ ^* be as defined in (6.1). If 

EX 2 / a (log + |X|) d - 1 - 1 / Q <oo, (6.5) 
where < a < 1 , £/iera, /or /? > 1 , 



\ T n , n+n o / 1 - a ( 



limsup liminf — = = a \\ — - — — erW — - — a.s. (6.6) 

nVl-^J V 2 l n l"logl n l V I 3 V V P J 

{nGA*} {n£A*} 

Conversely, if 

p( limsup JS^^L < oo^ >0, (6.7) 
V n^oo ^/|n| a log|n| / 

{n S A*} 
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then (6.5) holds, EA = and (6.6) holds with a 1 = VarX. 



The theorem tells us that the extreme limit points get closer and approach zero as /3 
increases, that is, the thinner the subsequence, the less wild are the observable oscilla- 
tions. 



Proof of Theorem 6.1. Since we consider subsequences, there are no gaps to fill. The 
only thing to check for the sufficiency is thus the independence for the lower bound, 
which is "immediate" since the subsequence here is sparser than that in (5.14). Indeed, 

(i + = ( i + lY 1 " > ;/3/(i— ) ( i + JL_\ 

\ i J \ 1 — Oi I 

= //(l— ) _|_ j(/3-l+a)/(l-a) >^/(l— ) + j(0«)/(l— ). 



The converse follows as in Theorem 2.1, so there is nothing more to prove there. □ 



Remark 6.1. An even closer inspection of the proofs shows that, in fact, Theorem 6.1 
remains true with i^A 1 — ) replaced by (j^-j)' 3 ^ 1- "'' or even by iA/( 1_a ) (log i) 132 for any 
Pi > 1 and 02 S R, and, more generally, by i /3 /( 1_a )£(i), where /3 > 1 and € is a slowly 
varying function. 

Remark 6.2. The results above show that the set of limit points of , "■"+" is given 
by the whole interval [— <j\J\ — a, ay/1 — a]. 



Remark 6.3. Theorem 6.1 also holds for the case d = 1, thereby providing an extension 
to subsequences of Lai's original result. 



As a special case, we mention the following result which tells us what happens if we 
consider the points along the diagonal. We leave the details to the reader. 



Theorem 6.2. Under the assumptions of Theorem 6.1, 



lim sup lim inf 

n^oo V iwoo 

{n=(i^/(i- = ),...,i/3/(i — ))} {n=(i' 9 /( 1 -°),...,i' 3 /( 1 -°))} 



v /2|rrpfogH 



'1 — a / /l — a 

= a 



dp V V dj3 



The converse is as before. 
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An LSL for the sequence of maximal windows or delayed sums is now easily attainable 
with the aid of the Levy inequalities; see Lai [15] for the case d= 1. 

Theorem 7.1. Suppose that {Xk,k€ Z^} are i.i.d. random variables with mean and 
finite variance a 2 , and set S n = X)k<n^ k > n ^ V (2-1) holds, then 

max <k<n a 7n,n+k 



limsup , = = — =o-\Jl—a a.s. 7.1 

™ v/2|n|«log|n| 



(7.2) 



Conversely, if 

( max <k<n° |T ni „ +k | \ 

P limsup 7 = = < oo > 0, 

V n^oo ^|n|«log|n| ) 

then (2.1) holds, EX = and (7.1) holds with a 2 = Vai X . 
Proof. Since 

|r nin+ „ Q |< max |T n , n+k |, 

0<k<n a 

the only implication that requires a proof is (2.1) =>• (7.1) and this is achieved with the 
aid of the Levy inequality Lemma 3.1(b), according to which 



< 2 d P(|T n , n+nQ | > £ ^|n|"log|n| -d v /2Var(T n , n+nQ )) 
<2 d P(|T n , n+nQ | > £ (l- ( 5)v / |n| Q log|n|) 
for any S > 0, provided n is sufficiently large. □ 
The LSL for subsequences carries over similarly. 

Theorem 7.2. Suppose that {X^,\iE Z^} are i.i.d. random variables with mean and 
finite variance a 2 , and set S n — X)k<n^ k > n e V (2-1) holds, then, for (3>1, 

max <k<n° 7n n+k 



{n:|n|=i*V(i-°0} / 1 - a fn oN 
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Conversely, if 

max <k<n° |Tn,n+k| 
limSUp {n:|n|^/(i-°)> . 

{n:|n|=*V(i-°0} 

i/iera (2.1) ZioZcfc, EX = and (7.3) holds with a 2 =VaxX. 



8. Additional results and remarks 

In this closing section, wc begin with some additional comments and remarks, after which 
we close with an LIL-type result derived via the delta method, which, in turn, is applied 
to the LIL as well as the LSL. 



8.1. The set of limit points is independent of d 

From the central limit theorem, we know that 

> N[0, u J as n — > oo. 



Moreover, the windows are disjoint (at least asymptotically). This means that, heuristi- 
cally, 

^ri.n ii " -Ma,n-fn° 1 



log |n| VlnF v^gH V lo gl n l' 
where {7 n ,n6 Z|} are i.i.d. N(0, cr 2 )-distributed random variables. This implies, among 
other-things, that one might expect {max n / T " , " + "° , n € Zi} to share the asymptotics 

\/|n| Q log|n| "f" 

of {max n — ==,n g Zi }, which would mean that, asymptotically, we are dealing with 
V lo sN 

a sequence of maxima of i.i.d. Gaussian random variables normalized by the logarithm 
of the number of them, which, of course, does not depend on the structure of the index 
set. 

For an interesting reference in the present context - maxima of Gaussian random fields 
- we refer to [16] . 



8.2. On the choice of subsequences 

In the course of the proofs, we have seen that the double- and triple-primed sums are 
negligible and that the size of the oscillations depends on the primed sums along a suit- 
ably selected subsequence. In the proofs of the LIL for sums, the exponential bounds 
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are exponentials of iterated logarithms, that is, powers of logarithms. In order to ob- 
tain a convergent sum (for the upper bound), the natural choices of subsequences are 
geometrically increasing ones. 

In our context, the exponential bounds are exponentials of single logarithms, that is, 
powers. In order to obtain a convergent sum (for the upper bound), the natural choices 
of subsequences are polynomially increasing ones. 

We also recall that in connection with Theorem 6.1, we observed that the oscillations 
become less wild as the subsequences get thinner. 



8.3. Functional LSL's 

A further project might be to consider possible functional or Strassen versions of our 
results. For references in the one-dimensional case, see, for example, [2, 6]. 

8.4. The LIL, the LSL and the delta method 

The following application of the so-called delta method to the law of the iterated loga- 
rithm might not be new. However, we have never seen it in the literature (cf., e.g., [11], 
page 349 in connection with the central limit theorem). 

Theorem 8.1. Suppose that {U n ,n > 1} is a sequence of random variables, for which 
there exist positive sequences {a n ,n> 1} and {b n ,n> 1} tending to infinity as n— >oo ; 
such that 

U n a.s. / n x 

— ► fi as n — ► oo (L) < \x < oo) 



and 

lim sup (lim inf )a n ( — — — [i J =1 (—1) a.s. (8-1) 

n->oo V ™^°° / V "n J 

(i) If g is continuously differentiable at (in a neighbourhood of) fi and </(/j) ^ 0, then 
limsup^hminf^a n ^^-^ ~ g((i)J =+|s'0)| Hff'G")!)- 



n — >oc 



(ii) If g is m > 2 times continuously differentiable at (in a neighbourhood of) \x, 
g( k \/j,) =0, k = l,2,,..,m — l, and g (m) (^) > ; say, then 

lim sup ( lim inf) a™/ 2 (g(^) 9^)) =+—J m) {») {-—/ m) ^)\, 

\ n^oo I v v o n I I ml \ 771! / 

if m is odd. If, on the other hand, m is even, then 

limsupa™/ 2 ^^) -g(n)) =+i- 5 ("»)( M ). 
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Proof, (i) By Taylor expansion, 



K J V b n 

where \9 n — fx\ < l^ 2 - — fi\, so that 

a "( 5 (ir) ~- 9( ^) =an (ir ~^j9'(s n ), 

and (i) follows. 

(ii) Using second-order Taylor expansion, and recalling that g'(fJ.) — 0, we similarly 
obtain 

which establishes (ii) in the case m = 2 and similarly in the other cases with higher order 
Taylor expansions. Note that one loses the sign of (y 2 - — fi) when m is even. □ 

Remark 8.1. In case the limit points in (8.1) are dense in [—1,1], the liminf in case 
(ii) for g( m \[±) > with m even is equal to zero. 

As immediate corollaries, we obtain the following results related to the Hartman- 
Wintner LIL ([13] or, e.g., [11], Theorem 8.1.2) and Lai's LSL for delayed sums [15], 
respectively. 

Corollary 8.1. Suppose that X,Xx,X%, ■ ■ ■ are i.i.d. random variables with mean fi and 
finite variance a 1 , and set S n = 2fe=i ^k; n>l. 

(i) If g is continuously differentiable at (in a neighbourhood of) fi and g'(fi) 7^ 0, then 



hm sup (liminf ) J r-^— ( g( — ) - g{n)) = W2|«/(//)| (-aV2\g'(»)\). 
n^oo \ ™^°° / V foglogn \ \ n J J 

(ii) If g is m > 2 times continuously differentiable at (in a neighbourhood of) /i, 
g^(n) = 0, k = 1,2, ...,m- 1, and g (m) (/x) > ; say, then 

lim sup (liminf) (- — ^ \ (g(— ) ~ g{p) 



ml \ ml J 



if m is odd. If on the other hand, m is even, then 

1/2 

s log log n 



lim sup 



9(-)-9{^=+-X<rV2) m g^{ l x) 
\ n J J ml 
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n \" l/ V fS r , 



and 

ii min f[__) i g i nil =0 . 

n->oo y log log nj \ \ n J J 

Proof. Use Theorem 8.1 with U n = S n , b n = n, ji = EA and a n = 0(yi lo ^ , and 

apply the strong law of large numbers and the Hartman-Wintner LIL in order to verify 
that the assumptions are fulfilled. An appeal to Remark 8.1 completes the proof. □ 

Corollary 8.2. Let X, X±,X2, ■ ■ ■ be i.i.d. random variables with mean and variance 
1 and suppose that E|A| 2 / Q (log + IAD" 1 /" < oo. Finally, set T n . n+n c = J2k=n+i X k- 

(i) If g is continuously differ entiable at (in a neighbourhood of) and <?'(0) ^ 0, then 
limsup(hminf)^( 5 (^) - ff (0)) = v%/(0)| (-^(0)|). 

(ii) If g is m > 2 times continuously differ entiable at (in a neighbourhood of) \i, 
c / ( fc )( /U ) = 0, k = 1,2, ...,m — 1, and g (m) (M) > 0, say, then 



m/2 

' -3(0) 



lim sup ( lim inf ) ( ^— ) ( g ( Tn ' n + n 

= + 1 2 m/2 ff (m)( ) (_J_2 m ^g ( - m \0)\ 

to! \ to! J 

if to is odd. If, on the other hand, to is even, then 

i/2 



and 



i^KiSo M 5 ^) - 9(o) ) - + sr"« w « , > 



Proof. Use Theorem 8.1 with U n — T nn+n a, b n = n a , (J, = and a n = </ 21 "° , and 



apply Chow's strong law [5] and Lai's LSL [15] in order to check the assumptions. For 
the case where to is even, use results of this paper together with Remark 8.1. □ 
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